Skip to content

[Tests] Add block manager and scheduler tests#3108

Merged
Yard1 merged 2 commits intovllm-project:mainfrom
rkooo567:block-manager-test
Mar 6, 2024
Merged

[Tests] Add block manager and scheduler tests#3108
Yard1 merged 2 commits intovllm-project:mainfrom
rkooo567:block-manager-test

Conversation

@rkooo567
Copy link
Copy Markdown
Collaborator

@rkooo567 rkooo567 commented Feb 29, 2024

This upstream unit tests inside Anyscale that test block manager and scheduler. Several new features that will be upstreamed will update this file (e.g., chunked prefill).

@rkooo567
Copy link
Copy Markdown
Collaborator Author

rkooo567 commented Mar 1, 2024

cc @simon-mo

@rkooo567
Copy link
Copy Markdown
Collaborator Author

rkooo567 commented Mar 1, 2024

This PR is ready to be reviewed.

@Yard1 Yard1 changed the title [WIP][Tests] Add block manager and scheduler tests [Tests] Add block manager and scheduler tests Mar 1, 2024
@zhuohan123
Copy link
Copy Markdown
Member

Will this PR conflict with #2762?

@rkooo567
Copy link
Copy Markdown
Collaborator Author

rkooo567 commented Mar 4, 2024

@zhuohan123 does it change the behavior of scheduler and block manager? I can merge the latest master

@rkooo567
Copy link
Copy Markdown
Collaborator Author

rkooo567 commented Mar 5, 2024

Seems to still pass tests after merging the latest master!

@Yard1 Yard1 merged commit 24aecf4 into vllm-project:main Mar 6, 2024
dtransposed pushed a commit to afeldman-nm/vllm that referenced this pull request Mar 26, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants